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ABSTRACT 



In 1990, the National Assessment of Educational Progress 
(NAEP) included a Trial State Assessment (TSA) ; for the first time in NAEP ' s 
history, voluntary state-by-state assessments were made. In 1994, TSA was 
expanded to include non-public school students. The 1994 reading assessment 
considered students' proficiency in situations that involved reading 
different kinds of materials for different purposes. The fourth-grade 
assessment measured two global purposes for reading- -reading for literary 
experience and reading to gain information. In Utah, 2,733 students in 105 
public schools were assessed. This report describes the reading proficiency 
of Utah fourth-graders and compares their overall performance to students in 
the West region of the United States and the nation (using data from the NAEP 
national assessments) . The distribution of reading results and reading 
achievement level results are provided for subpopulations of students 
(race/ethnicity, type of location, parents, educational level, and gender). 
Reading proficiency and achievement of non-public school students are 
separately reported and compared to public school students. To provide a 
context for the assessment data, participating public school students, their 
reading teachers, and principals completed questionnaires which focused on; 
policies and practices related to reading (time for instructional activities 
and instructional resources for reading) ; delivery of reading instruction 
(instructional materials and activities, workbooks/ worksheets/writing, 
discussion and group activities, time to read, reading and use of libraries, 
assessing progress in reading) ; reading instructors (preparation, experience 
and professional development); students' home support for literacy (reading 
outside of school and in the home and hours of television watched per day) . 
The average reading proficiency of public school students in Utah on the NAEP 
reading scale was 217 compared to 212 nationwide. (CR) 
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What is The Nation’s Report Card? 



THE NATION’S REPORT CARD, the National Assessment of Educational Progress (NAEP), is the only nationally representative and continuing 
assessment of what America’s students know and can do in various subject areas. Since 1969, assessments have been conducted periodically in 
reading, mathematics, science, writing, history/geography, and other fields. By making objective information on student performance available to 
policymakers at the national, state, and local levels, NAEP is an integral part of our nation’s evaluation of the condition and progress of education. 
Only information related to academic achievement is collected under this program. NAEP guarantees the privacy of individual students and their 

families. _ / oj i. • rru 

NAEP is a congressional ly mandated project of the National Center for Education Statistics, the U.S. Department of Education. 1 ^ 

Commissioner of Education Statistics is responsible, by law, for carrying out the NAEP project through competitive awards to qualified organiza- 
tions. NAEP reports directly to the Commissioner, who is also responsible for providing continuing reviews, including validation studies and 

solicitation of public comment, on NAEP’s conduct and usefulness. ..... 

In 1988, Congress established the National Assessment Governing Board (NAGB) to formulate policy guidelines for NAEP. The Board is 
responsible for selecting the subject areas to be assessed from among those included in the National Education Goals; for setting appropriate student 
performance levels; for developing assessment objectives and test specifications through a national consensus approach; for designing the 
assessment methodology; for developing guidelines for reporting and disseminating NAEP results; for developing standards and procedures for 
interstate, regional, and national comparisons; for determining the appropriateness of test items and ensuring they are free from bias; and for taking 
actions to improve the form and use of the National Assessment. 
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EXECUTIVE 

SUMMARY 



In 1988, Congress passed legislation for the National Assessment of Educational 
Progress (NAEP) that continued its primary mission of providing dependable and 
comprehensive information about educational progress in the United States. In addition, 
for the first time in the project’s history, the legislation also included a provision 
authorizing voluntary state-by-state assessments on a trial basis. 

As a result of the legislation, the 1990 NAEP program included a Trial State 
Assessment Program in which public-school students in 37 states, the District of 
Columbia, and two territories were assessed in eighth-grade mathematics.' The 1992 
NAEP program included an expanded Trial State Assessment Program in fourth-grade 
reading and fourth- and eighth-grade mathematics, with public-school students assessed 
in 41 states, the District of Columbia, and two territories.^ 

The continuation of NAEP’s Trial State Assessment Program in 1994 weis 
authorized by additional legislation that enlarged the state-by-state assessment to include 
non-public school students. In addition to the state assessment program in reading at 
grade 4, the 1994 NAEP involved national assessments of reading, world geography, 
and U.S. history at grades 4, 8, and 12. The 1994 Trial State Assessment Program was 
conducted in February 1994 with 44 participants (41 states, the District of Columbia, 
Guam, and the Department of Defense Education Activity [DoDEA] Overseas Schools). 

This computer-generated report describes the reading proficiency of fourth-grade 
public school students in Utah, the West region, and the nation. The distribution of 
reading proficiency results and reading achievement level results are provided for groups 
of students defined by shared characteristics: race/ethnicity, type of location, parents’ 
education level, and gender. Contextual information about reading policies, instruction, 
and home support for reading is presented for public school students. State results are 
based on the representative sample of students who participated in the 1994 Trial State 
Reading Assessment Program. Results for the region and the nation are based on the 
regional and national representative samples of students who participated in the national 
NAEP assessment. 

' For a summary of the 1990 program, see Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. 
The State of Mathematics Achievement: NAEP’s 1990 Assessment of the Nation and the Trial Assessment of the States. 
(Washington, DC: National Center for Education Statistics, 1991). 

^ For a summary of the 1992 assessment of reading, see Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The 
NAEP J992 Reading Report Card for the Nation and the States. (Washington, DC: National Center for Education 
Statistics, 1993). For a summary of the 1992 assessment of mathematics, see Ina V.S. Mullis, John A. Dossey, Eugene 
H. Owen, and Gary W. Phillips. NAEP J992 Mathematics Report Card for the Nation and the States. (Washington, 
DC: National Center for Education Statistics, 1993). 
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Utah 



School and Student Participation in the Reading Assessment 

In Utah, 105 public schools participated in the 1994 fourth-grade reading 
assessment. This number includes participating substitute schools that were selected to 
replace some of the nonparticipating schools from the original sample. The weighted 
school participation rate after substitution in 1994 was 100 percent for public schools, 
which means that the fourth -grade students in this sample were directly representative 
of 100 percent of all the fourth-grade public school students in Utah. 

In Utah, 2,733 public school fourth-grade students were assessed in 1994. The 
weighted student participation rate was 95 percent for public schools. This means that 
the sample of fourth-grade students who took part in the assessment was directly 
representative of 95 percent of the eligible public school student population in 
participating schools in Utah (that is, all students from the population represented by 
the participating schools, minus those students excluded from the assessment). 

The overall weighted response rate (school rate times student rate) was 95 percent 
for public schools. This means that the sample of students who participated in the 
assessment was directly representative of 95 percent of the eligible fourth-grade public 
school population in Utah. 

Following standard practice in survey research, the results presented in this report 
were produced using calculations which incorporate adjustments for the nonparticipating 
schools and students. Hence, the final results derived from the sample provide estimates 
of the reading proficiency and achievement for the full population of eligible public 
school fourth-grade students in Utah. However, these nonparticipation adjustments may 
not adequately compensate for the nndssing sample schools and students in instances 
where nonparticipation rates are large. 

In order to guard against potential nonparticipation bias in published results, NCES 
has established minimum participation levels necessary for the publication of 1994 Trial 
State Assessment results. NCES also established additional guidelines that address four 
ways in which nonparticipation bias could be introduced into a jurisdiction’s published 
results (see Appendix A). In 1994, Utah failed to meet minimum participation rate 
guidelines for non-public schools. Hence, only public school results are included in this 
report. Utah met all established NCES participation rate guidelines for public schools. 
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Students’ Readin2 Performance 

The table below shows the distribution of reading proficiency of fourth-grade 
students attending public schools in Utah, the West region, and the nation. 

1994, Public School Students 

The average reading proficiency of fourth-grade public school students 
in Utah on the NAEP reading scale was 217. This average was higher 
than that of students across the nation (212).^ The lowest performing 
10 percent of public school fourth graders in Utah had proficiencies at 
or below 170 while the top 10 percent had proficiencies at or above 260. 

In public schools across the nation, the lowest performing 10 percent 
of fourth graders had proficiencies at or below 156; the top performing 
10 percent of students had proficiencies at or above 261. 

1992 vs 1994, Public School Students 
There was no significant change in the average performance of 
fourth-grade public school students in Utah from 1992 to 1994 (220 in 
1992 and 217 in 1994). During the same period, there was no 
significant change in the average performance of fourth-grade public 
school students across the nation (215 in 1992 and 212 in 1994). 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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^ Differences reported as significant are statistically different at the 95 percent confidence level. TTiis means that with 
95 percent confidence there is a real difference in the average reading proficiency between the two populations of 
interest. 
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Performance According to Purpose for Reading 

The 1994 Trial State Assessment Program considered students’ performance in 
situations that involved reading different kinds of materials for different purposes. The 
fourth‘grade reading assessment measured two global purposes for reading — reading 
for literary experience and reading to gain information. The table below provides 
results for Utah, the West region, and the nation according to each reading purpose. 

1994y Public School Students 

The proficiency of public school students in Utah in reading for literary 
experience (222) was higher than that of students across the nation 
(214). However, in reading to gain information, the proficiency of 
public school students in Utah (212) did not differ significantly from that 
of students across the nation (210). 

1992 vs 1994, Public School Students 
Utah’s public school fourth graders showed no significant change from 
1992 to 1994 in reading for literary experience. However, in reading 
to gain information, public school fourth graders in Utah exhibited a 
decline from 1992 to 1994. 
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Distribution of Reading Proficiency for Fourth-Grade 
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Reading 
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The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school 
students in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Utah 



Levels of Reading Achievement 

The most recent reauthorization of the National Assessment Governing Board 
(NAGB) continues the Board’s responsibilities to set policy for NAEP and to “develop 
appropriate student achievement levels for each age and grade in subject areas tested” 
(Pub. L. 103-382). 

NAGB developed three achievement levels for each grade — Basic, Proficient, 
and Advanced. Performance at the Basic level denotes partial mastery of the knowledge 
and skills that are fundamental for proficient work at each grade level. The central level, 
called Proficient, represents solid academic performance at each grade level tested. 
Students reaching this level demonstrate competency over challenging subject matter and 
are well prepared for the next level of schooling. Performance at the Advanced level 
signifies superior performance at the grade tested. Definitions of the three levels of 
reading achievement are given below. Chapter 3 provides further elaboration of these 
levels and presents examples of types of questions that students at each of the three 
achievement levels can respond to effectively. 
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Description of Fourth-Grade Reading Achievement 
Levels 



Achievement 

Level 


Scale 

Outpoint 


Description 


w»sm. 

ItfifKsni 


268 


Fourth-grade students performing at the Advanced level 
should be able to generalize about topics in the reading 
selection and demonstrate an awareness of how authors 
compose and use literary devices. When reading text 
appropriate to fourth grade, they should be able to judge 
texts critically and, in general, give thorough answers that 
indicate careful thought. 


Bill 

msiii 


238 


Fourth-grade students performing at the Proficient level 
should be able to demonstrate an overall understanding 
of the text, providing inferential as well as literal 
information. When reading text appropriate to fourth grade, 
they should be able to extend the ideas in the text by 
making inferences, drawing conclusions, and making 
connections to their own experiences. The connection 
between the text and what the student infers should be 
clear. 


iiiii 


208 


Fourth-grade students performing at the Basic level should 
demonstrate an understanding of the overall meaning of 
what they read. When reading texts appropriate for fourth 
graders, they should be able to make relatively obvious 
connections between the text and their own experiences. 
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Utah 



The table below provides the percentage of fourth-grade students at or above each 
achievement level, as well as the percentage of students below the Basic level. 

1994y Public School Students 

The percentage of public school students in Utah who were at or above 
the Proficient level (30 percent) did not differ significantly from that 
of students across the nation (28 percent). 

1992 vs 1994y Public School Students 
From 1992 to 1994, there was no significant change in the percentage 
of public school students in Utah who attained the Proficient level 
(30 percent in 1992 and 30 percent in 1994). Similarly, there was no 
significant change in the percentage of public school students across the 
nation who attained the Proficient level (27 percent in 1992 and 
28 percent in 1994). 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1 992 at about the 95 percent confidence level. 



Subpopulation Performance 

Assessment results repeatedly show differences in performance for subpopulations 
of students.'^ The 1994 Trial State Assessment provides additional information about 
the performance of important subpopulations by reporting on the reading proficiencies 
of various subgroups of the public school student population defined by race/ethnicity, 
type of location, parents’ education level, and gender. These results are summctrized in 
the table on page 8. 
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Ina V.S. Mullis, John A. Dossey, Jay R. Campbell, Claudia A. Gentile, Christine O’Sullivan, and Andrew S. Latham. 
NAEP 1992 Trends in Academic Progress. (Washington, DC: National Center for Education Statistics, 1994). 
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Race/Ethnicity 

1994, Public School Students, The average reading proficiency of White 
students in Utah public schools was higher than that of Hispanic and 
American Indian students. 

7992 vs 1994, Public School Students, There was no significant change 
in the average reading proficiency of White or Hispanic public school 
students in Utah from 1992 to 1994. 

Type of Location 

1994, Public School Students. The average reading proficiency of Utah 
students attending public schools in central cities was not significantly 
different from that of students in urban fringe/large towns and rural 
areas/small towns. 

7992 vs 1994, Public School Students. From 1992 to 1994, there was 
no significant change in the average reading proficiency of students 
attending public schools in central cities, urban fringe/large towns, or 
rural areas/small towns in Utah. 

Parents’ Education Level 

1994, Public School Students. Public school students in Utah reporting 
that at least one parent graduated from college demonstrated an average 
reading proficiency which did not differ significantly from that of 
students who reported that at least one parent had some education after 
high school but was higher than that of students who reported that at 
least one parent graduated from high school or they did not know their 
parents’ education level. 

7992 7994, Public School Students. The average proficiency of public 

school students in Utah who reported that at least one parent graduated 
from college, at least one parent had some education after high school, 
at least one parent graduated from high school, or they did not know 
their parents’ education level did not change significantly between 1992 
and 1994. 



Gender 

1994, Public School Students. In public schools in Utah, girls exhibited 
an average reading proficiency which was higher than that of boys. 

7992 vs 1994, Public School Students. In Utah public schools, the 
average reading proficiency for boys did not change significantly from 
1992 to 1994. Similarly, the average proficiency for girls did not change 
significantly from 1992 to 1994. 
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American Indian 
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TYPE OF LOCATiON- 


Central City 


Utah 
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' 217(2.5) 
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PARENTS’ EDUCATiON 
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College graduate 
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Some educ after HS Utah 
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; . 215(1.9)' 
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Nation 


211 {1.8) 


206^{i;9)^: 


1 don’t know 


Utah 


' ,214 (1.5)' 


' 2{»^(y:4);'y ' 


GENDER 


West 

Nation 


207 (i:e)^ = 
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203 (^2.4) ^ ' 
204(^1. 3) ,_':'y;i/.v:;r; 


Male 


Utah 

West 


' ' ' 217(1.5);' 
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' . 2i3{.1.7)VV\'^>;>t ' 
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Nation 


'211 (1;3) 
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Female 


Utah 


' 224 V12V ^ : 
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West 


'216 ( 1:3) ' ' 


' ' 217.(2.5).::^' 




Nation 


' . ' =219 Ei;i): 
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* School sample size is insufficient to permit reliable regional results for type of location. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
*** Sample size is insufficient to permit a reliable estimate. 



17 



o 

ERIC 



8 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Utah 



A Context for Understanding Students^ Reading Proficiency in Public Schools 

Information on the reading performance of students in Utah can be better 
understood and used for improving instruction and setting policy when supplemented 
with contextual information about schools, teachers, and students. 

To gather contextual information, the fourth-grade students participating in the 
1994 Trial State Assessment, their reading teachers, and the principals or other 
administrators in their schools were asked to complete questionnaires on policies, 
instruction, and programs. The student, teacher, and school data help to describe some 
of the current practices and emphases in reading education, illuminate some of the 
factors that appear to be related to fourth-grade public-school students’ reading 
proficiency, and provide an educational context for understanding information on student 
achievement. Highlights of the results for the public-school students in Utah are as 
follows: 

CURRICULUM COVERAGE AND INSTRUCTIONAL EMPHASIS 

• In Utah in 1994, average reading proficiency was similar for students 
regardless of how much time their reading teachers spent on reading 
instruction on a typical day. 

• According to the public school administrators in Utah, in 1994, 

75 percent of the fourth-grade students were in schools where reading 
was identified as receiving special emphasis. This percentage was not 
significantly different from* that of students across the country 
(85 percent). 

• In 1994, according to their reading teachers, 21 percent of the students 
in public schools in Utah were typically taught reading in a class that 
was grouped by reading ability. The prevalence of ability grouping was 
not significantly different across the nation (22 percent). 



DELIVERY OF READING INSTRUCTION 

• Students in Utah whose teachers used both basal and trade books 
demonstrated an average reading proficiency (218) which did not differ 
significantly from that of students whose teachers primarily used basal 
readers (218). 

• The proficiency of Utah students whose teachers used both basal and 
trade books (218) was not significantly different from that of students 
whose teachers primarily used trade books (219). 

• The proficiency of Utah students whose teachers primarily used trade 
books (219) was not significantly different from that of students whose 
teachers primarily used basal readers (218). 
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* Although the difference may appear large, recall that “significance” here refers to “statistical significance.” (See 
Appendix A for further discussion.) 
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• In Utah, 25 percent of the fourth-grade students had reading teachers 
who used children’s newspapers and/or magazines at least once a week; 
30 percent of the students had reading teachers who used reading kits 
at least once a week; 23 percent had reading teachers who used 
computer software for reading instruction at least once a week; 
75 percent of the students had reading teachers who used a variety of 
books at least once a week; and, finally, 63 percent of the students had 
reading teachers who used materials from other subject areas at least 
once a week. 

• According to the Utah reading teachers, 59 percent of the students were 
asked to discuss new or difficult vocabulary almost every day. This 
percentage did not differ significantly from that of students across the 
nation (62 percent). 

• According to their reading teachers, the percentage of students in Utah 
who were asked to talk with each other almost every day about what 
they have read (27 percent) was smaller than that of students across the 
nation, where 34 percent of the students were asked to do this activity 
almost every day. 

• According to the reading teachers in Utah, 7 percent of the students 
were asked to do a group activity or project about what they have read 
almost every day. This figure was not significantly different from that 
of students across the nation (5 percent). 



EDUCATIONAL BACKGROUND OF TEACHERS 

• The percentage of students who were being taught by reading teachers 
who reported having at least a master’s or education specialist’s degree 
in Utah (28 percent) was smaller than that for the nation (41 percent). 

• About three quarters of the students (76 percent) had reading teachers 
who had the highest level of teaching certification that is recognized by 
Utah. This was greater than the figure for the nation, where 65 percent 
of the students were taught by reading teachers who were certified at the 
highest level available in their states. 

• In Utah, 25 percent of the students were being taught reading by 
teachers who had an undergraduate major in English, reading, 2 uid/or 
language arts. This was greater than the percentage of students across 
the nation who were being taught by reading teachers with the same 
major (20 percent). 
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HOME FACTORS 

• In Utah, 39 percent of the students reported having four types of reading 
materials (a newspaper, an encyclopedia, 25 or more books, and 
magazines) in the home. This figure was not significantly different from 
that for the nation (36 percent). Students in Utah who had all four of 
these types of materials in the home showed an average reading 
proficiency (222) which was higher than that of students with zero to 
two types of materials (208). 

• In 1994 in Utah, 25 percent of the students discussed with friends or 
family what they read almost every day. This percentage was somewhat 
smaller than that of students across the nation (28 percent). The 
proficiency of students in Utah who discussed what they read with 
friends or family almost every day (217) did not differ significantly from 
that of students who had discussions with friends or family less than 
weekly (213). 

• Relatively few of the fourth-grade students (9 percent) watched six 
hours or more of television each day. This was smaller than the figure 
for the nation, where 22 percent of the students watched this much 
television. Average reading proficiency in Utah was lowest for students 
who spent six hours or more watching television each day. 

Comparisons of Overall Reading Proficiency in Utah with Other States 

The map on the following page provides a method for making appropriate 
comparisons of the overall public school reading proficiency in Utah with that in other 
states (including Guam and the Department of Defense Education Activity [DoDEA] 
Overseas Schools) that participated in the NAEP 1994 Trial State Assessment Program. 
The different shadings of the states on the map show whether the average overall 
proficiency of public school students in the other states was statistically different from 
or not statistically different from that of public school students in Utah (“Target State”). 
States in black have a significantly lower average public school proficiency than does 
Utah. States with a dark-gray shading have a significantly higher average public school 
proficiency than does Utah. States with a light-gray shading have an average public 
school proficiency that does not differ significantly from that of Utah. The significance 
tests are based on a Bonferroni procedure for multiple comparisons that holds the 
probability of erroneously declaring the means of any two states to be different, when 
they are not, to no more than five percent. Two states — Idaho and Michigan — did 
not meet minimum school participation guidelines for public schools. Another 
jurisdiction — Washington, DC — withdrew from the Trial State Assessment after the 
data collection phase. Therefore, these three jurisdictions are not included in the 
comparisons depicted on the map on the following page. 
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Comparisons of Overall Reading Proficiency 
Grade 4 Public Schools 
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OVERVIEW 



or over 25 years, the National Assessment of Educational Progress (NAEP) 
has been the nation’s primary indicator of student achievement, reporting on what 
students know and can do in various school subject areas at grades 4, 8, and 12. With 
legislation passed by Congress in 1988, NAEP’s mission of providing dependable and 
comprehensive information about educational progress in the United States was 
expanded to involve a voluntary state-by-state assessment on a trial basis. 

Consequently, the 1990 NAEP program included a Trial State Assessment 
Program in which public school students in 37 states, the District of Columbia, and two 
territories were assessed in eighth-grade mathematics.^ Building on this initial effort, 
the 1992 NAEP program included a Trial State Assessment Program in fourth-grade 
reading and fourth- and eighth-grade mathematics, with public school students assessed 
in 41 states, the District of Columbia, and two territories.® 

The continuation of NAEP’s Trial State Assessment Program in 1994 was 
authorized by additional legislation that enlarged the state-by- state assessment to include 
non-public school students: 

The National Assessment shall conduct in 1994 ... a trial reading 
assessment for the 4th grade, in states that wish to participate, with the 
purpose of determining whether such assessments yield valid and 
reliable State representative data. (Section 406(i)(2)(C)(i) of the 
General Education Provisions Act, as amended by Pub. L. 103-33 
(U.S.C. 1221e-l(a)(2)(B)(iii))) 

The National Assessment shall include in each sample assessment . . ■ 
students in public and private schools in a manner that ensures 
comparability with the national sample. (Section 406(i)(2)(C)(i) of the 
General Education Provisions Act, as amended by Pub. L. 103-33 
(U.S.C. 1221 e-1 (a )(2 )(B)(iii))) 
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^ For a summary of the 1990 program, see Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. 
The State of Mathematics Achievement: NAEP's J990 Assessment of the Nation and the Trial Assessment of the States. 
(Washington, DC: National Center for Education Statistics, 1991). 

^ For a summary of the 1992 assessment of reading, see Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The 
NAEP 1992 Reading Report Card for the Nation and the States. (Washington, DC: National Center for Education 
Statistics, 1993). For a summary of the 1992 assessment of mathematics, see Ina V.S. Mullis, John A. Dossey, Eugene 
H. Owen, and Gary W. Phillips. NAEP J992 Mathematics Report Card for the Nation and the States. (Washington, 
DC: National (Tenter for Education Statistics, 1993). 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



23 



15 



Utah 



o 

ERIC 



In addition to the state assessment program in reading at grade 4, the 1994 NAEP 
involved national assessments of reading, geography, and history at grades 4, 8, and 12. 

The 1994 Trial State Assessment Program was conducted in February 1994 with 
the following 44 participants: 



Alabama 


Louisiana 


North Dakota 


Arizona 


Maine 


Pennsylvania 


Arkansas 


Maryland 


Rhode Island 


California 


Massachusetts 


South Carolina 


Colorado 


Michigan 


Tennessee 


Connecticut 


Minnesota 


Texas 


Delaware 


Mississippi 


Utah 


District of Columbia 


Missouri 


Virginia 


Florida 


, Montana 


Washington 


Georgia 


Nebraska 


West Virginia 


Hawaii 


New Hampshire 


Wisconsin 


Idaho : 


New Jersey 


Wyoming 


Indiana 


New Mexico 




■-Jowa;..: 


New York 


; Guam 


Kentucky 


North Carolina i 


DoDEA 



Jurisdictions in italics — Montana, Washington, and the Department of Defense 
Education Activity (DoDEA) Overseas Schools — did not participate in the 1992 Trial 
State Assessment Program. Two states — Idaho and Michigan — did not meet minimum 
school participation guidelines for public schools. Another jurisdiction — Washington, 
DC — withdrew from the Trial State Assessment Program after the data collection 
phase. Therefore, public school results for these three jurisdictions are not reported. 
Three jurisdictions — Ohio, Oklahoma, and the Virgin Islands — participated in the 
1992 Trial State Assessment but not in the 1994 program. 

For the 1 994 Trial State Assessment in reading, a combined sample of 
approximately 2,800 public and non-public school students was assessed in most 
jurisdictions. The samples were carefully designed to represent the fourth-grade 
populations in the states or jurisdictions. Participating jurisdictions were responsible for 
the administration of the assessment. For jurisdictions that participated in the 1992 Trial 
State Assessment Program, contractor staff monitored 25 percent of public school 
sessions and 50 percent of non-public school sessions. For jurisdictions that did not 
participate in 1992, contractor staff monitored 50 percent of both public and non-public 
school sessions. Monitoring efforts were part of a quality assurance program designed 
to ensure that sessions were conducted uniformly. 

The 1992 Trial State and National Assessment programs in reading were based 
on a framework developed through a national consensus process that was set forth by 
law and called for “active participation of teachers, curriculum specialists, subject matter 
specialists, local school administrators, parents, and members of the general public” 
(Pub. L. 100-297, Part C, 1988).^ This same framework served as the basis of the 1994 
Trial State and National Assessment programs. 

^ NAEP Reading Consensus Project. Reading Framework for the 1992 and 1994 National Assessment of Educational 
Progress. (Washington, DC: National Assessment Governing Board, U.S. Department of Education, 1994). 
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The process of developing the framework was carried out in late 1989 and early 
1990 by the Council of Chief State School Officers (CCSSO) under contract from the 
National Assessment Governing Board (NAGB) which is responsible for formulating 
policy for NAEP, including developing assessment objectives and test specifications. 
The framework development process included gathering input from a wide range of 
people in the fields of reading and assessment, such as school teachers, administrators, 
and state coordinators of reading and reading assessment. After thorough discussion and 
some amendment, the framework was adopted by NAGB in March 1990. An overview 
of the reading framework is provided in Appendix A. 

The 1994 fourth-grade Trial State and National Assessments in reading consisted 
of eight sections or blocks, each 25 minutes in length. All fourth-grade students in the 
assessment were required to complete two blocks. Each block contained a passage or 
set of passages and a combination of constructed-response and multiple-choice 
questions. Passages selected for the assessment were drawn from authentic texts used 
by students in typical reading situations. Complete stories, articles, or sections of 
textbooks were used, rather than excerpts or abridgements. The type of question — 
constructed-response or multiple-choice — was determined by the objective being 
measured. In addition, the constructed-response questions were of two types: short 
constructed-response questions which required students to respond to a question in a few 
words or a few sentences and extended constructed-response questions which required 
students to respond to a question in a paragraph or more. 



This Report 

This is a computer-generated report that describes the reading performance of 
fourth-grade public school students in Utah, in the West region, and across the nation. 
A separate report describes additional fourth-grade reading assessment results for the 
nation and the states, as well as the national results for grades 8 and 12.* This report 
consists of four sections: 

• This Overview provides background information about the 1994 Trial 
State Assessment Program and a profile of the fourth-grade students in 
Utah. 

• Part One shows the distribution of reading proficiency results for 
fourth-grade public school students in Utah, the West region, and the 
nation. 

• Part Two presents reading achievement level results for public school 
fourth graders in Utah, the West region, and the nation. 

• Part Three relates fourth-grade public school students’ reading 
proficiency to contextual information about the reading policies, 
instmction, and home support for reading in Utah, the West region, and 
the nation. 
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® See NAEP J994 Reading Report Card for the Nation and the States. 
Statistics, 1995). 
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In this report, results are provided for groups of students defined by shared 
characteristics — race/ethnicity, type of location, parents’ education level, and gender. 
Based on criteria described in Appendix A, data are reported for subpopulations only 
where sufficient numbers of students and adequate school representation are present. 
For public school students, there must be at least 62 students in a particular subgroup 
from at least 10 different schools. However, the data for all students, regardless of 
whether their subgroup was reported separately, were included in computing overall 
results for Utah. Definitions of the subpopulations referred to in this report are presented 
below. 

The results for Utah are based on the representative sample of students who 
participated in the 1994 Trial State Assessment Program. The results for the nation and 
the region of the country are based on the nationally and regionally representative 
samples of students who were assessed in January through March as part of the national 
NAEP program. Using the national and regional results from the 1994 national NAEP 
program is necessary because of the voluntary nature of the Trial State Assessment 
Program. Since not every state participated in the program, the aggregated data across 
states did not necessarily provide representative national or regional results. Specific 
details on the samples and analysis procedures used can be found in the Technical Report 
of the 1994 NAEP Trial State Assessment Program in Reading,^ 

Race/Ethnicitv 

Results are presented for students of different racial/ethnic groups based on the 
students’ self-identification of their race/ethnicity according to the following mutually 
exclusive categories: White, Black, Hispanic, Asian, Pacific Islander, and American 
Indian (including Alaskan Native). In 1992, the question posed to students regarding 
their racial/ethnic background had one Asian/Pacific Islander category. In 1994, these 
were two distinct response options for the question. Consequently, data and trend results 
for the separate categories are not available for the 1992 sample. 

Type of Location 

Results are provided for students attending public schools in three mutually 
exclusive location types — central city, urban fringe/large town, and rural/small town 
— as defined below. The type of location variable is defined in such a way as to indicate 
the geographical location of a student’s school. The intention is not to indicate, or 
imply, social or economic meanings for these location types. The type of location 
variable, given the current NAEP sampling, does not support the reporting of regional 
results. Therefore, only state and national results will be presented. 

Central City: The Central City category includes central cities of all 
Standard Metropolitan Statistical Areas (SMSA’s).‘° Central City is a 
geographic term and is not synonymous with “inner city.” 




9 

Technical Report of the NAEP 1994 Trial State Assessment Program in Reading. (Washington. DC: National Center 
for Education Statistics, 1995). 

Standard Metropolitan Statistical Area (SMSA) as defined by the Office of Management and Budget. 
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Urban Fringe/Large Town: An Urban Fringe includes all densely 

settled places and areas within SMSA’s that are classified as urban by 
the Bureau of the Census. A Large Town is defined as places outside 
SMSA’s with a population greater than or equal to 25,000. 

Rural/Small Town: Rural includes all places and areas with a 

population of less than 2,500 that are classified as rural by the Bureau 
of the Census. A Small Town is defined as places outside SMSA’s 
with a population of less than 25,000 but greater than or equal to 2,500. 

Parents^ Education Level 

Students were asked to indicate the extent of schooling for each of their parents 
— did not finish high school, graduated from high school, had some education after high 
school, graduated from college, or did not know. The response indicating the higher 
level of education was selected for reporting. Note that a substantial percentage of 
fourth-grade students did not know their parents’ education level. 

Gender 

Results are reported separately for males and females. 

Region 

The United States has been divided into four regions for purposes of this report: 
Northeast, Southeast, Central, and West. States included in each region are shown in 
Figure 0.1. All 50 states and the District of Columbia are listed, with the participants 
in the 1994 Trial State Assessment Program highlighted in boldface type. Guam and 
the Department of Defense Education Activity (DoDEA) Overseas Schools were not 
assigned to a region. Further, students attending public schools in the part of Virginia 
that is included in the Washington, DC, metropolitan statistical area are included in the 
Northeast regional results; students attending public schools in the remainder of the state 
are included in the Southeast regional results. Because most of the Virginia students 
are in the Southeast region, regional comparisons for Virginia are to the Southeast. 

Regional results are based on national assessment samples, not on aggregated Trial 
State Assessment samples, as explained on the previous page. Thus, the regional results 
are based on a different and separate sample from that used to report the state results. 
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FIGURE 0.1 

Regions of the Country 
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Note: Part of Virginia (near metropolitan Washington, DC) is included in the Northeast region, and the rest of Virginia 
is in the Southeast region. 



Guidelines for Analysis and Reporting 

This report describes reading performance for public school fourth graders and 
compares the results for various groups of students within that population — for 
example, those who have certain demographic characteristics or who responded to a 
specific background question in a particular way. The report examines the results for 
individual demographic groups and individual background questions. It does not include 
an analysis of the relationships among combinations of these subpopulations or 
background questions. 

Because the percentages of students in these subpopulations and their average 
proficiencies are based on samples — rather than on the entire population of fourth 
graders in a jurisdiction — the numbers reported are necessarily estimates. As such, they 
are subject to a measure of uncertainty, reflected in the standard error of the estimate. 
When the percentages or average proficiencies of certain groups are compared, it is 
essential to take the standard error into account, rather than to rely solely on observed 
similarities or differences. Therefore, the comparisons discussed in this report are based 
on statistical tests that consider both the magnitude of the difference between the means 
or percentages and the standard errors of those statistics. 
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The statistical tests determine whether the evidence — based on the data from the 
groups in the sample — is strong enough to conclude that the means or percentages are 
really different for those groups in the population. If the evidence is strong (i.e., the 
difference is statistically significant), the report describes the group means or 
percentages as being different (e.g., one group performed higher than or lower than 
another group) — regardless of whether the sample means or sample percentages appear 
to be about the same or not. If the evidence is not sufficiently strong (i.e., the difference 
is not statistically significant), the means or percentages are described as being not 
significantly different — again, regardless of whether the sample means or sample 
percentages appear to be about the same or widely discrepant. The reader is cautioned 
to rely on the results of the statistical tests — rather than on the apparent magnitude of 
the difference between sample means or percentages — to determine whether those 
sample differences are likely to represent actual differences between the groups in the 
population. The statistical tests and Bonferroni procedure, which is used when more 
than two groups are being compared, are discussed in greater detail in Appendix A. 

In addition, some of the percentages reported in the text of the report are given 
quantitative descriptions (e.g., relatively few, about half, almost all, etc.). The 
descriptive phrases used and the rules used to select them are also described in 
Appendix A. 

Finally, in several places in this report, results (mean proficiencies and 
percentages) are reported in the text for combined groups of students. For example, in 
the text, the proficiency of students in the combined group who reported reading for fun 
once or twice a month or never or hardly ever is given and compared to the group who 
reported reading for fun almost every day. However, the table that accompanies that text 
reports percentages and proficiencies separately for the four groups (almost every day, 
once or twice a week, once or twice a month, and never or hardly ever). The combined 
group proficiencies reported in the text and used in all statistical tests are based on 
unrounded estimates (i.e., estimates calculated to several decimal places) of the 
proficiencies for each group. The percentages shown in the tables are rounded to 
integers. Thus, percentages may not always add up to 100 percent due to rounding. 
Also, the percentage for a combined group (reported in the text) may differ slightly from 
the sum of the separate percentages (presented in the tables) for each of the groups that 
were combined. Therefore, if statistical tests were to be conducted based on the rounded 
numbers in the tables, the results might not be consonant with the results of the statistical 
tests that are reported in the text (based on unrounded numbers). 
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Profile of Utah 

Fourth-Grade School and Student Characteristics 

Table 0.1 provides a profile of the demographic characteristics of the fourth-grade 
public school students in Utah, the West region, and the nation. This profile is based 
on data collected from the students and schools participating in the 1992 and 1994 Trial 
State and National Assessments. As described earlier, the state data and the regional 
and national data are drawn from separate samples. 

Schools and Students Assessed 

Table 0.2 summarizes participation data for schools and students sampled in Utah 
for both the 1992 and 1994 Trial State Assessments.^* In Utah, 105 public schools 
participated in the 1994 fourth-grade reading assessment. This number includes 
participating substitute schools^ that were selected to replace some of the nonparticipating 
schools from the original sample. The weighted school participation rate after 
substitution in 1994 was 100 percent for public schools, which means that the 
fourth-grade students in this sample were directly representative of 100 percent of all 
the fourth-grade public school students in Utah. 

In each school, a random sample of students was selected to participate in the 
assessment. In 1994, as estimated by the sample, 2 percent of the fourth-grade public 
school population were classified as Limited English Proficient (LEP), while 1 1 percent 
in public schools had an Individualized Education Plan (lEP). An lEP is a plan, written 
for a student who has been determined to be eligible for special education, that typically 
sets forth goals and objectives for the student and describes a program of activities 
and/or related services necessary to achieve the goals and objectives. Students with 
disabilities may be categorized as lEP. 

Schools were permitted to exclude certain students from the assessment, provided 
that certain criteria were met. To be excluded, a student had to be categorized as 
Limited English Proficient or had to have an Individualized Education Plan and (in 
either case) be judged incapable of participating in the assessment. The intent was to 
assess all selected students; therefore, all selected students who were capable of 
participating in the assessment should have been assessed. However, schools were 
allowed to exclude those students who, in the judgment of school staff, could not 
meaningfully participate. The NAEP guidelines for exclusion are intended to assure 
uniformity of exclusion criteria from school to school. Note that some LEP euid lEP 
students were deemed eligible to participate and not excluded from the assessment. The 
students in Utah who were excluded from the assessment because they were categorized 
as LEP or had an lEP represented 6 percent of the public school population in 
grade 4. 
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For a detailed discussion of the NCES guidelines for sample participation^ see School and Student Participation Rates 
for the Reading Assessment and Guidelines for Participation. (Washington. DC: National Center for Education 
Q Statistics, 1994); or see Appendix B of the Technical Report of the NAEP 1994 Trial State Assessment Program in 

Reading. (Washington, DC: National Center for Education Statistics, 1995). 
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TABLE 0.1 

Profile of Fourth-Grade Public School Students in 
Utah, the West Region, and the Nation 
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— Separate statistics for Asian and Pacific Islander students were not available in 1 992. 

* School sample size is insufficient to permit reliable regional results for type of location. 

The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. The percentages for Race/Ethnicity may not add to 100 percent because 
some students categorized themselves as “Other.” 
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In Utah, 2,733 public school fourth-grade students were assessed in 1994. The 
weighted student participation rate was 95 percent for public schools. This means that 
the sample of fourth-grade students who took part in the assessment was directly 
representative of 95 percent of the eligible public school student population in 
participating schools in Utah (that is, all students from the population represented by 
the participating schools, minus those students excluded from the assessment). 

The overall weighted response rate (school rate times student rate) was 95 percent 
for public schools. This means that the sample of students who participated in the 
assessment was directly representative of 95 percent of the eligible fourth-grade public 
school population in Utah. 

Following standard practice in survey research, the results presented in this report 
were produced using calculations which incorporate adjustments for the nonparticipating 
schools and students. Hence, the final results derived from the sample provide estimates 
of the reading proficiency and achievement for the full population of eligible public 
school fourth-grade students in Utah. However, these nonparticipation adjustments may 
not adequately compensate for the missing sample schools and students in instances 
where nonparticipation rates are large. 

In order to guard against potential nonparticipation bias in published results, NCES 
has established minimum participation levels necessary for the publication of 1994 Trial 
State Assessment results. NCES also established additional guidelines that address four 
ways in which nonparticipation bias could be introduced into a jurisdiction’s published 
results (see Appendix A). In 1994, Utah failed to meet minimum participation rate 
guidelines for non-public schools. Hence, only public school results are included in this 
report. Utah met all established NCES participation rate guidelines for public schools. 

In the analysis of student data and reporting of results, nonresponse weighting 
adjustments have been made at both the school and student level, with the aim of making 
the sample of participating students as representative as possible of the entire eligible 
fourth-grade public school population. For details of the nonresponse weighting 
adjustment procedures, see the Technical Report of the NAEP 1994 Trial State 
Assessment Program in Reading, 
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TABLE 0.2 

Profile of the Fourth-Grade Population Assessed in 
Utah 



1994 Trial State Assessment 
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Utah’s non-public school weighted participation rate for the initial sample was less than 70%. 
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PART ONE 



The Reading Proficiency of Fourth-Grade 
Pubiic Schooi Students in Utah 

IR-eading involves the interaction between and among a reader, a text, and a 
situation.*^ Thus, students’ reading comprehension is influenced by the type of material 
read and the specific purposes for reading. The 1994 Trial State Assessment Program 
considered students’ proficiency in situations that involved reading different kinds of 
materials for different purposes. The fourth-grade reading assessment measured two 
global purposes for reading — reading for literary experience and reading to gain 
information. Students’ proficiency on each of the two purposes for reading was 
summarized on separate NAEP reading scales (one for each purpose), which range from 
0 to 500. In addition, results for an overall reading scale reflecting average proficiency 
across the two purposes for reading are also presented. The overall reading scale also 
ranges from 0 to 500. 

This part of the report contains two chapters that describe the reading proficiency 
of fourth-grade students in Utah. Chapter 1 compares the overall reading proficiency 
of public school students in Utah to the West region and the nation. It also presents the 
students’ average proficiency for the two purposes for reading. Chapter 2 summarizes 
reading proficiency for subpopulations of public school students defined by 
race/ethnicity, type of location, parents’ education level, and gender. 




J.A. Dole, G.G. Duffy, L.R. Roehler, and P.D. Pearson, “Moving from the Old to the New: Research on Reading 
Comprehension Instruction,*’ in Review of Educational Research, 6L (1991). pp. 239-264. 



The eighth- and twelfth-grade national NA£P reading assessments also measured a third purpose for reading — reading 
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CHAPTER 1 



Students’ Reading Proficiency 

In 1994, renewed emphasis was placed on national education goals when Congress 
reauthorized the Elementary and Secondary Education Act (ESEA) and enacted the Goals 
2000: Educate America Act. A concern for higher academic standards is evident in the 
ESEA's efforts to provide programs to improve America's schools. Goals 2000 reasserts 
the importance of establishing and meeting rigorous goals in the education of our 
nation’s students — All students will leave grades 4, 5, and 12 having demonstrated 
competency over challenging subject matter including English, mathematics, science, 
foreign languages, civics and government, economics, arts, history, and geography, and 
every school in America will ensure that all students learn to use their minds well, so they 
may be prepared for responsible citizenship, further learning, and productive employment 
in our nation 's modern economy. Reading ability can be viewed as an enabling skill for 
reaching these goals. Therefore, concern about attaining these goals and, more 
specifically, about the reading abilities of our nation’s students has increased because 
recent NAEP results appear to indicate that many students of all ages have difficulty 
reading thoughtfully.^"^ 

The NAEP Reading Framework underlying both the 1992 and 1994 assessments 
views reading as a dynamic, complex interaction between and among the reader, the text, 
and the context of the reading experience. Readers, for example, bring to the reading 
process their prior knowledge about a topic, their reasons for reading, their individual 
reading skills and strategies, and their understanding of differences in text structures.’^ 

The texts used in the NAEP reading assessment are representative of common 
reading demands. Because reading performance varies in response to texts and contexts, 
the NAEP assessment measured students’ abilities to read different types of materials 
for different purposes. The texts were selected from naturally-occurring sources that are 
typically available to children in and out of school. Students in grade 4 were asked to 
respond to liter 2 U 7 and informational texts, corresponding with the two purposes for 
reading assessed at grade 4 — reading for literary experience and reading to gain 
information. 
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Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The NAEP 1992 Reading Report Card for the Nation and the 
States. (Washington, DC: National Center for Education Statistics, 1993); Ina V.S. Mullis, John A. Dossey, Jay R. 
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Progress. (Washington, DC: National Center for Education Statistics, 1994). 

J.A. Danger. “The Process of Understanding: Reading for Literary and Informational Purposes,” in Research in the 
Teaching of English, 24. (1990). pp. 229-260; NAEP Reading Consensus Project. Reading Framework for the 1992 
and 1994 National Assessment of Educational Progress. (Washington, DC: National Assessment Governing Board, 
U.S. Department of Education, 1994). 
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Reading for literary experience typically involves the reader in vicarious 
experiences through the story’s characters or considerations of how the author explores 
human events. Literary texts include short stories, poems, and folktales that engage the 
reader in a variety of ways, not the least of which is reading for fun. Reading to gain 
information may involve seeking to learn about a topic or to search for specific 
information. Informational texts include selections from textbooks, magazines, 
encyclopedias, and other written sources whose purpose is to increase the reader’s 
knowledge. Differences between narrative and informational text typically require 
students to use different skills and strategies. 

In addition to having fourth graders demonstrate their ability to read for two 
different purposes, the assessment asked students to build, extend, and examine meaning 
from four stances or types of interactions with the text. 

Initial Understanding 

Students are asked to provide the overall or general meaning of the 
selection. This includes first impressions, main points, or themes. 

Developing an Interpretation 

Students are asked to extend the ideas in the text by making inferences 
and connections. This includes making connections between cause and 
effect, analyzing the motives of characters, and drawing conclusions. 

Personal Response 

Students are asked to make explicit connections between the ideas in the 
text and their own background knowledge and experiences. This 
includes comparing story characters with themselves or people they 
know, or indicating whether they found a passage useful or interesting. 

Critical Stance 

Students are asked to consider the text objectively. This includes 
identifying how the author crafted a text with stylistic devices such as 
mood and tone. 

These stances are not considered hierarchical or completely independent of each 
other. Rather, they are viewed as recursive processes that take place throughout reading 
and represent different dimensions of the reader’s understanding. They provide a frame 
for generating assessment questions and considering student performance at all levels. 
All students at all levels should be able to respond to reading selections from all of these 
stances. What varies with students’ developmental and proficiency levels is the amount 
of prompting or support needed to elicit their responses, the complexity of the texts to 
which they can respond, and the sophistication of their answers. 

This chapter describes the reading proficiency of Utah’s public school fourth 
graders in 1994 and the comparative results of their regional and national counterparts. 
In addition, this chapter provides a compcirison of reading performance in 1992 and 1994 
for Utah’s fourth graders attending public schools. 
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Table 1,1 shows the distribution of reading proficiency of fourth-grade students 
attending public schools in Utah, the West region, and the nation, 

1994y Public School Students 

The average reading proficiency of fourth-grade public school students 
in Utah on the NAEP reading scale was 217. This average was higher 
than that of students across the nation (212).*^ The lowest performing 
10 percent of public school fourth graders in Utah had proficiencies at 
or below 170 while the top 10 percent had proficiencies at or above 260. 

In public schools across the nation, the lowest performing 10 percent 
of fourth graders had proficiencies at or below 156; the top performing 
10 percent of students had proficiencies at or above 261. 

1992 vs 1994, Public School Students 
There was no significant change in the average proficiency of 
fourth-grade public school students in Utah from 1992 to 1994 (220 in 
1992 and 217 in 1994). During the same period, there was no 

significant change in the average proficiency of fourth-grade public 
school students across the nation (215 in 1992 and 212 in 1994). 
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TABLE 1.1 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students 



1994 Trial State Assessment 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 



Differences reported as significant are statistically different at the 95 percent confidence level. This means that with 
95 percent confidence there is a real difference in, the average reading proficiency between the two populations of 
interest. ^ 
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Proficiency According to Purpose for Reading 

As previously indicated, the questions in the 1994 Trial State Assessment Program 
covered two purposes for reading at grade 4 — reading for literary experience and 
reading to gain information. Table 1.2 provides results for Utah, the West region, and 
the nation according to each reading purpose. 

1994y Public School Students 

The proficiency of public school students in Utah in reading for literary 
experience (222) was higher than that of students across the nation 
(214). However, in reading to gain information, the proficiency of 
public school students in Utah (212) did not differ significantly from that 
of students across the nation (210). 

1992 vs 1994, Public School Students 
Utah’s public school fourth graders showed no significant change from 
1992 to 1994 in reading for literary experience. However, in reading 
to gain information, they exhibited a decline from 1992 to 1994. 
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TABLE 1.2 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students According to Purpose for 
Reading 





Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 




Reading for Literary Experience 














1992 Public 


;■ h 












Utah 




-480 12 : 4 )^ 


^2Q2 { 2.0) 


'••225^(1-3) ■■ 


-245(1.4) ; 




West 


2ie,(1:7) : 


168(2.5), 


. 192 ( 3.2) ' 


:-21X(2.0) : 


::24i (32). -: 


-:'261 (-1.9); 


Nation 


: 217 ( 1.0); 




; 1M(12> ;. ^ 


^219(1,1) 






1994 Public 




_ 


SiSiliilBB 


y-i- 






Utah 




■ = i73’-'E3.0) 


^: 260 :( 1 . 0 ) 


: -225 (' 1 : 3 ) y- 


= 248; 




West 


'213 ( 2.4) ^ . 


. t53 ( 3,9)<'i 


187(3.7), ; 


■ 218 ( 2 : 0 ) 


■ 248 (2 Ay.-., 


.■■■'ZB4{.±Syyr 


Nation 


'214(12); - 


157 < 


yi^.(:1,6). 


: 219 (4.1) 


::2;^'(;12)':y; 


4-204;(>fl-:3)y : 


Reading to Gain Information 








'...'-pyV-.- ; 






1992 Public 






\ -: '-Ty. 


■ 






Utah 


>210.(12) 


'■ 176t3:0)' 


^I97'(;i.6)y'^i 


219 ( .1.6) 


■24b''(:l;2):-'.: 


•;?257fT.7Ky 


West 


-.207 ( 2.0)': : 




y182 <-2.9)vy” 




-:234 (2.0)^, ; 


^■'"256 


Nation 




-■i62.(h-8) ; 


;i87(1.4) ,y 


. 214 { 12) 


■;:^,(:i.3);;,> 


;/259fi:9)>y 


1994 Public 






liilliiliilllll 






if;:. I :y 


Utah 


.212 (1. 6) ' < 




'• 1.188 (1J9) < i 


';215i(1.7)'y''i 


'iMi(■.1:8);■: 


::;;259 


West 


,210 ( 22) . - 


}^56iA.7) ; 


/183(3.0f 


:'.215:(2.5>':' ' 


242 ( 2.3) ' 




Nation 


.2i6fl2)'l 


-151 (2:o)<^ 




y2i4'X'i.5);- 


:-24d't43)-y; 


■■'£262 '(4:4)''^ 



The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details), if the notation > (<) appears, it signifies that the value for public school 
students in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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CHAPTER 2 



Reading Proficiency of Fourth-Grade 
Students by Subpopulations 



The overall reading proficiency of public school students across the country 
presented in the previous chapter provides a global view of the state of reading 
performance. However, it is also important to look more closely at the performance of 
subgroups and to consider how different groups of children are progressing in reading. 
This information can provide educators, policy makers, and concerned citizens with 
important knowledge about how well students from different backgrounds and with 
different experiences are developing as readers. 

The 1994 Trial State Assessment Program provides additional information about 
the reading proficiency of important subpopulations by reporting on the performance of 
various subgroups of the public school student population defined by race/ethnicity, type 
of location, parents’ education level, and gender. 



The 1994 Trial State Assessment Program results for different racial/ethnic groups 
can be compared when the number of schools and students in a racial/ethnic group is 
of sufficient size to be reliably reported. (See Appendix A for details.) Table 2.1 
presents reading proficiency results for White, Hispanic, and American Indian 
fourth-grade public school students from Utah. 

1994y Public School Students 

As shown in Table 2.1, the average reading proficiency of White 
students in Utah public schools was higher than that of Hispanic and 
American Indian students. 



Race/Ethnicity 
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1992 vs 1994, Public School Students 
There was no significant change in the average reading proficiency of 
White or Hispanic public school students in Utah from 1992 to 1994. 
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TABLE 2.1 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Race/Ethnicity 



1994 Trial State Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 


White 




' '' 












1992 


Utah 


■••^3 (-1;0)- i 


. : ,184 :( 1,7)'; 


'.'204 t1 '.2) 


225(1.5)' 


• 244 (m:0) ■ '•■ 


■?^‘9.('1.8)^ 




West 


' 22 : 0 .( 117 ) 


175, (3,0)1 : 


:,199(2,0) 


223 ( 1,9) • 


244(1,2) . 


262,(2.6) . 




Nation 




:■ 180(2.3);: ; 


=: 202.( f.4>. , 


.;225.(1,6)..:-: 


:246(di3).;; 


264(1,6) ; 


1994 


Utah 


^1 (.1:3)^ 


. 17€(2i7), 


200.(2.1) : 


224 (M) r 


:245(;i.6) 


. 263(1,3) . 




West 


.222 ( 2,0) ^ 


M.70i(;46) . / 


200di^^) 


. :226.(2.0) '-:. ..:.. 


;::^247-.(=.i:9)^ 


266 ( 2,5) : 




Nation 


^3('i:3)' 


: 175:( 2.3) ■ = 


20i;(17) 


226(1.4) . 


;:..247. (,il); .. 


266 ;( 2:4) 


Hispanic 






illBiiiilllliil 




i'.V:;- ■ - 'I'.' 




1992 


Utah 


( 2.3)' / 


"i 163' (6.6)^' 


183^(5,4) 


'204 ( 4.4).: 


226 ( 2.5) 


244 (14i) 




West 


19 . 6 ( 2 . 70 . 


.^i52.(,7.2)\'. 


174 ( 3.4) 


^ 197 ( .2.0) .: : 


. 220 :( 3,5) - . 


..240 ( 2,3) . 




Nation 








: : 339 .( 3,5 V 


ii;225:( 3S);^ ^ 


, :245;‘(l4) 


1994 


Utah 


199 ( 2.5) . 


1-47, '( ,6:6) 


.176 ( 4,0) ■ / 


205 ( 3i) 


227 ( 1.4) 


. 246 ( 4.0) .. 




West 


■ = ,i86{-4-4)\: 




.■■■'T'58.(:4:6)-- 


^■-188;(. 5.3):-"' 


' 215(3,0) 


:^239 {5:2); 




Nation 


.188 ( 2:7) < 


pm,(;4.7)i- 


I6bj;3,5)'.<:.. 


,189 ( 4.2) ; 


= ■217(3.5). 


242.(3.6) 


American Indian 




r';:| 


.= J 








1992 


Utah 


■ r 








; *** *f\ 






West 
















Nation 




;:;;155iC9,2):;; 


‘■■183; (.9:1)- 


209 ( 8.8) ; 


2 ^ ( 4.O) 


2^ (6,7) ' : 


1994 


Utah 


195(513) ^ 




:'.:d73"(13;5) 


■ 200(10.8);, 


::220.('7.€) :V: 


. 236 (26,3) ' 




West 








■■■• . 








Nation 


200 ( 3.6) : : 


,i.^145:( S;6) 


,;174(8^),;':i 


=205 ( 2.6) 


==.2^ (5.2) . 


.■ 250:(4;,0) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. *** Sample 
size is insufficient to permit a reliable estimate. 
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Type of Location 

Table 2.2 presents the reading proficiency results for fourth-grade students 
attending public schools in central cities, urban fringe/large towns, and rural areas/small 
towns. 



1994, Public School Students 

The results indicate that the average reading proficiency of Utah students 
attending public schools in central cities was not significantly different 
from that of students in urban fringe/large towns and rural areas/small 
towns. 



1992 vs 1994, Public School Students 
From 1992 to 1994, there was no significant change in the average 
reading proficiency of students attending public schools in central cities, 
urban fringe/large towns, or rural areas/small towns in Utah. 
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TABLE 2.2 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Type of Location 



1994 Trial State Assessment 


Average 

Proficiency 


1(Hh 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 




Central City 






:r v,7:: i'A;'?-/ 




5:.. j 




1992 


Utah 


.:219;<25j -:L 




:^;i98C3.8).^.. 


‘520C44) ' 


24T(24) 


.;''25'7'( 2.^ 




Nation 






( 2^6);.:;: 


209. 1 1"9) 


'2^.(1.9> 


"■253‘( 2.6V ; ' 


1994 


Utah 


:215 f 3:5) 




^;r492'(:4:3)-C- 


^;220fa0)-. ^ 


■244 ( 2:4)'..!. 


262 C3.1) 




Nation 






,{4;74;X-34);L: 


; 208 ( 3.0) ' 


■ 235' (2.7) 


256 (:2.0> 


Urban Fringe/Large Town 














1992 


Utah 


-:2J2:ct{V.5ylJ 


=fiii^.(-£i):'\l/ 


^:2So:r2^b)o; } 


! 223 (1:6); ■ - 


'‘;.242(’'l.6V:::v: 


‘';25'8(:‘1.4)'":' 




Nation 


:.:2i9.(:2J2)i 


/:173C4;4) 


196(2.0) ' 


■-,222(.'26)C;. 


245(1.9) 




1994 


Utah 


219(1.5) 


;:^174:(4:1):L.; 






v.i43:(‘ii5);"j: 


.V^ (;'3.1> .-:i' 




Nation 


.:-219.(;;i.9) 


,,.4^ (4,1 


('3'ro); . 


;'.i^3j(-.4:i)Ji:;'^ 


: ■.246^(1.7) 


;T^2i^.(:3;b)fn^ 


Rural/Small Town 




■■ -'o' ■ 0 


-T'' 


:: 






1992 


Utah 


V- 


!i'184’=Cl.8y 


J=204^(C4)>'" 




■:^243'(:2:5) 


•;:i253x!‘4:b)''j: 




Nation 


.;^^7(21'5) 


,.;Vl73'|2,8) " 




. ^0{ 2.7) 


'240 ( 2.4). 


258^3:9)/ r 


1994 


Utah 


■/217C2.8): 5 . 






221’ (±6)'? 


. 24l (3.3) 


■¥258 '{''2!i>:''!'' 




Nation 


j213:("-l'.8); f." 






: ^7.'( tJ)-':'' 


240 C2.1) 


:-.-^'=260 ■(■'2N>V'.:= 



School sample size is insufficient to permit reliable regional results for type of location. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Parents’ Education Level 

Previous NAEP findings have shown that students who report their parents are 
better educated tend to have higher reading proficiency.’’ Table 2.3 shows the results 
for fourth-grade public school students reporting that at least one parent graduated from 
college, at least one parent had some education after high school, at least one parent 
graduated from high school, or they did not know their parents’ education level. Note 
that a substantial percentage of fourth graders indicated that they did not know their 
parents’ education level. Furthermore, research suggests that some fourth graders’ 
reports on parents’ education level are almost certainly not accurate descriptions of their 
parents’ actual education levels.’® Such considerations should be kept in mind when 
interpreting fourth grade proficiency results for different parental education levels. 

1994y Public School Students 

As shown in Table 2.3, public school students in Utah reporting that at 
least one parent graduated from college demonstrated an average reading 
proficiency which did not differ significantly from that of students who 
reported that at least one parent had some education after high school 
but was higher than that of students who reported that at least one parent 
graduated from high school or they did not know their parents’ 
education level. 



1992 vs 1994y Public School Students 
The average proficiency of public school students in Utah who reported 
that at least one parent graduated from college, at least one parent had 
some education after high school, at least one parent graduated from 
high school, or they did not know their parents’ education level did not 
change significantly between 1992 and 1994. 
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” Ina V.S, Mullis, Jay R. Campbell, and Alan E. Farstrup. The NAEP 1992 Reading Report Card for the Nation and the 
States. (Washington, DC: National Center for Education Statistics, 1993.) 

E. Dianne Looker. “Accuracy of Proxy Reports of Parental Status Charaaeristics,” in Sociology of Education, 62(4). 
(1989). pp. 257-276. 
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TABLE 2.3 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Parents^ Level of Education 



1994 Trial State Assessment 


Average 


10th 


25th 


50th 


75th 


90th 






Proficiency 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 


College graduate 
1992 Utah 
West 
Nation 


.227 A) . 
. 219.(2,8) 
223.(i.6)^ 


186,(3.4) 
171 ( 3,4) 
175 (. 3:5);, 


.,208.(2,0) 
196 ( 5.0) 
^(2:1) 


' 230 ( 2,2) ^ 
< 222 (3.4) 

■ 226 ( 2,1) ■ 


/248 (1 ,3) 
'.245(4.1) '■ 
249 (1:4) ; 


263(2l2) ' i 
■v264 ( 3.4) y ■' 

• 267j2:4)'.s 


1994 


Utah 

West 

Nation 


^^226(1:5) 
;;.223:(2.4)>.. 
';222 ( 1.4) 


.182 (io) ' 

.168(4,0) 

1^(1.9) 


: 205 ( 2,5) , ; 
201 ( 3,2) : 

199(1.4) 


.'^9 ( 1.6) ^ 
229( 2.3) ' 

: '227. (\7) 


^2'^ ('2,1 )/' 

' 25T'(aT)'V 
'249 - 


; 267 (1,8)^ 

' 270 (:2,4) . 
.269 ( l;:6); 


Some education after HS 
1992 Utah 
West 
Nation 


{ 2:5) . 
'••223 fas) 
J;;221 ■< 2.4); V 


187(8.6) " 
177(5.4) " 
177(9.0) >. 


^ 209 ( 1.6) ■ . 
:201 (12.6) 
.201.(3,3) . 


231 (3.6) 

: 224 ( 2.9) . 
' 223(:2.9) 


•249 ( 2.4) ^ 
.:247.{,.ai); . 
. 245 ( 3:6) ;. 


y .265 (.34) 

/ 264.(7.5) 

1 7-5) . ; 


1994 


Utah 

West 

Nation 


■5'^ ('’2.5): 

• 221 ( 5.1) : ' 
.;^(2.2) 


181 ( 7.4) " 
,173 (17.7) ^ 
T71 ( 9,6) ^ 


207 (4.6) 

; 199 ( 8:1) 

V 199 ( 4,3): y 


228(2.5) ■ 
: = 224 ( 7.9) 

/ :^6(:3.9) = 


246(2.9)^ 

. 248(6,1) , 
248.(3:1):; '1 


, ^ (10.9) ' 

^^264,(13:0): .. 

266.( 3:9)^ ; 


High school graduate 
1992 Utah 
West 
Nation 


V215-{ T,9)^ ■■ 
>'210(44'-'. 
:i2ii (3.8) ^ 


T80 (=:4.0) 
163 ( 4.9) V, 
>:165 (.1.6) 


198 (1.8) 
^.189;(3.2).-.’ 

: .190. (2.8).;.'.; 


, 216(/2.-1)-.; 
. 2l i.(6.4): 

;^.2i4;('=.2.6)' 


;.234:f aS)-. '-'i 

; .237 (.6.7) ' . 

'i:;.2a4;(:2:6)v ■- 


•/ 249 ^(2,5) 
2S3iZ:7) 

. . 252 ( 2.B) : 


1994 


Utah 

West 

Nation 


' *211^.2.6) :■ 
r20i:(3.9) : 

^;-206.( 1.9) . . 


164 ( 9:5) 
:M40.(7.0) ; 
:T.49 ,( 3.b) < 


' 189^6-5)' y: 
173(14.4) , 
:^.181.(2.6) 


J214.(.4.2) 
210( 4.0) . , 

; ■■2i.2=<-6'^); ■; . 


■.;,.237:(.6.2) . 
i 233 ( 4.7)’ . 

.=■ 24) , - .. 


.^5(2,6)' / 
250(6.7) 
255 ( 4.0) 


1 don’t 
1992 


know 

Utah 

West 

Nation 


;kl4-(.1.S) 

■.:a)'7(i.6) 


. 17Si(2.2),! 
160' (4,8)./ 

^ 1^ (. 1^9): 01 


J 195'(='3.i)' ■/ 
/ 186(1.7); 

;■ 187;('V8)- ;■ 


216(2,0) 
2i0 ( 1.6) ■ 

;ai2(1.5) 


; 2;» (2,3) ^ 
,232 ( r.7) ^ 


5 252 ( 3,9) ; 
, 249 ( 4:9) 
^,251(2.2), 


1994 


Utah 

West 

Nation 


; ' '209 (1.4) . . 
.^3 ( 2.4) 
,204(:i.3) - 


M61 (3.7) <. 

147 ( 4/1):: ■ 
,:'1^(3.1) :< 


.188 ( 2.8y. .1 

M774:5;2) ' 
y .i79i('2,2);';- 


■'il3( t.9) ■■ 
:207( 4J); : 
r20B { iA)^ 


■:i. 234.‘^( 2:8) ''-: 
233 (a4) V 
234- (-lie)'. ^ ; 


^'r;^(l;6) ;/ 

2^ ( 3,0) .^ 
253(1.9) . 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Gender 

In general, NAEP reading assessment results for males and females support 
numerous studies that have revealed gender differences favoring females in reading.*^ 
As shown in Table 2.4, the 1994 Trial State Assessment Program results for Utah are 
consistent with those general findings. 

1994y Public School Students 

In public schools in Utah, girls exhibited an average reading proficiency 
which was higher than that of boys. 

1992 vs 1994y Public School Students 
In Utah public schools, the average reading proficiency for boys did not 
change significantly from 1992 to 1994. Similarly, the average 
proficiency for girls did not change significantly from 1992 to 1994. 
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TABLE 2.4 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Gender 



1994 Trial State Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 


Male 












: ' ' 


1992 Utah 


•' 21 7-{li) 


'■T76:('3.8):- 




2i9( 1.9) 


■■239-( T-7)':C i 


. :^6(1:2) 


West 


207 {.2.6) ^ ■ 


^159(7.0>;r 


•M85'( 6.d) . 


::^9(3:o): , 


233:(3.0) : 


254 .(.21).. 


Nation 




: 163(2.1) 


' 1 ; 




237 ( 20): ; ; 


:;256(24) 


1994 Utah 




■■ 164' 


'■ll9dT'2.2)^=;ii 


:i216(1.7)-/'.; 


1239( 20)./. : 


257(22) 


West 


207 ( 2i) : i 


-:’146 c-5:9)::^" 


1179' ( 5.3)' lii:" 


■ "212'’(3.3).. •; 


;238(3:2) 


= 258(1-5) 


Nation 


/207 (:l:3) : - 


:v-i;49:(iii8)<'' 


;■ :i8i,:{ 1-0); <V 


211,(1.8). ; 


237 (i:2)'l:: 


257:(1.9)./. 


Female 


•- .V 




■ . v', ,■■■ 






< - : 


1992 Utah 




;Ci85:(2-5p?- 




'r225('l-.6C’’,-'" 


■"245 (ilid) 


. ^i;( 2.4j ; 


West 




: 168 ( 2.2) ^ 


= i;:194 ( 2.9). ; 


?219^( 


242- ( 2.5) - '' 


' 261(26). 


Nation 




1-73;(2.;1.).— r 




<221 (T.i) . ; 


2^ (: i;6)^ 


y 


1994 Utah 




h"1-^:f2:iV- ' 


■■:i‘2oi':(:2-2); 


'225 ( 4.2) ■="' 


"246'.(’i:7) 


1‘264;(-12)' 


West 


. 217( 2:5) 


l'62if5:0)'Tv=^ 




{.3:7)' L 


: 245' {2^) ' ^ 


265 ('3-9) . 


Nation 


■:.248 


165 (1-6);<: 


t:194 ( 2:oy ' ^ 


222 ( 2J3)^ 


•245 '( .i:4) ' 


:.264 ( 2.1) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 



Proficiency According to Purpose for Reading 

Table 2.5 provides a summary of results according to each of the two purposes 
for reading by race/ethnicity, type of location, parents’ education level, and gender for 
public school students. 
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